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We study a connection between the algebraic probability and classical stochastic processes described by 
master equations. Introducing a definition of a state which has not been used for quantum cases, the classical 
stochastic processes can be reformulated in terms of the algebraic probability. This reformulation immediately 
gives the Doi-Peliti formalism, which has been frequently used in nonequilibrium physics. As an application 
of the reformulation, we give a derivation of basic equations for counting statistics, which plays an important 
role in nonequilibrium physics. 
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I. INTRODUCTION 



^ . A 'classical' stochastic process plays an important role in studies of nonequilibrium physics. Here, 'classical' means 
that there is no quantum effect. However, in spite of the 'classical' features, there are many analytical methods 
analogous to those in quantum mechanics. One of famous examples is the Doi-Peliti formalism*—, which is also 
called the field-theoretic method or second quantization method. In the Doi-Peliti formalism, bosonic creation and 
annihilation operators are used, and due to the similarity with the quantum mechanics, perturbation calculations 
c/2 ■ and renormalization group methods have been employed, which give us useful understandings for nonequilibrium 
behaviors-. Another example of applications of quantum mechanical formulations to classical stochastic processes is 
a geometric phase concept. The geometric phase concept has been used in order to discuss nonequilibrium behaviors 
caused by external perturbations to stochastic processes^—. Discussions for the Berry phase or Aharanov-Anandan 
phase in quantum mechanics have been applied, and various analytical results have been obtained. It is expected 
that further investigations for the similarity between quantum mechanical formulations and the classical stochastic 
Q processes enable us to give useful methods and deep understanding for nonequilibrium physics. 

In the present paper, we show that a scheme of the algebraic probability gives a unified way to discuss certain types 
of classical stochastic processes. Employing a Jacobi sequence and an interacting Fock space, we define a state suitable 
for the classical stochastic processes. This formulation gives an easy way to see the mathematical structure of the Doi- 
Peliti formalism; a natural connection between the Doi-Peliti formalism and orthogonal polynomials is obtained. The 
Doi-Peliti formalism corresponds to the canonical commutation relation, and we will show that the unifying method 
based on the interacting Fock space is also applicable for other cases, for example, the canonical anticommutation 
relations; as an example, a simple hopping model used in nonequilibrium physics is described in terms of the algebraic 
probability. In addition, as an application of the formulation to other nonequilibrium physics, we discuss the counting 
statistics, which is an important method in order to investigate nonequilibrium behaviors. We note that the counting 
' statistics has been used as a basis for the geometric phase discussions in the classical stochastic processes. Through 
■ the discussions, a conventional generating function method in the previous works can be reinterpreted in the algebraic 
probability. This reinterpretation is useful to construct a modified transition matrix, which plays a central role in 
the counting statistics. We will also show that this scheme is available even for the counting statistics for continuous 
values, which is needed, for example, to investigate entropy productions in nonequilibrium systems. 

The present paper is constructed as follows. In Sec.|TTl we briefly review discussions for a Jacobi sequence, interacting 
Fock space, and the algebraic probability. A definition of a state is also proposed here. Two examples are given in 
Sec. IIII1 in which a connection between the scheme of the algebraic probability and the Doi-Peliti formalism is also 
discussed. In Sec. we apply the scheme of the algebraic probability to the counting statistics. Two interacting 
Fock spaces are combined in order to calculate a net flow, and it is shown that a modified transition matrix, which 
is used in order to describe time evolution equations for generating functions, is simply constructed. Finally, we give 
some concluding remarks in Sec. IVl 
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II. ALGEBRAIC PROBABILITY FOR CLASSICAL STOCHASTIC PROCESSES 



A. Jacobi sequence and interacting Fock space 



We give brief explanations for some concepts which is needed to define a state for classical stochastic processes. 
Definitions, properties, and explanations here are based on Ref. § for details, see Ref. [^. 

A Jacobi sequence is a sequence {u> n ; n = 1, 2, • • • } which satisfies one of the following two conditions: (i) io n > 
for all n; (ii) there exists a number m > 1 such that ui n = for all n > m and lo 71 > for all n < m . Hereafter, we 
mainly give discussions for case (i); in order to discuss case (ii), the number mo should be introduced adequately. 

We next introduce an orthonormal basis {$ n ;n = 0, 1, •••} in an infinite-dimensional Hilbert space. Using the 
Jacobi sequence, linear operators are introduced as follows: 

S+$ n = V^+T^n+i, n = 0,l,---, (1) 

B-$ o = 0, B-$„ = V^$„_i, n = l,2,.... (2) 

We will call B + a creation operator, and _B~ an annihilation operator. The connection among the orthonormal basis 
{$„}, the Jacobi sequence {u> n } and the linear operators B is expressed as follows schematically: 



$0 ^ $1 ^ $ 2 ^ ■■• ^ $ n _! <=* $„ <=t $ n+1 



r is defined as a linear subspace spanned by {(B + ) n $o; n = 0, 1, 2, . . . }, and the inner product of T is denoted by (•, •); 
by construction, ($,„,$„) = 5 m>n , where 5 m , n is the Kronecker delta. The quadruple Ti u \ = (r, {$„}, B + , B~) is 
called an interacting Fock space associated with the Jacobi sequence {w„}. In addition to the linear operators B , 
an additional operator N is defined as 

N$ n = n$„. (3) 

The operator N is called the number operator, and it is used frequently in the following discussions. 

While we introduce the orthonormal basis {$ n }, it is useful to define a slightly different basis, i.e., an orthogonal 
basis, in order to discuss the classical stochastic processes. We define a basis {$ n } as follows: 



$„ = VWn'-'Wl$n- (4) 



Hence, 



B+ *„ = *„ +1 , n = 0,l,---, (5) 
S-$ = 0, S-# w n = l,2,---, (6) 

and ($ m , $ n ) = w„ ■ • ■ wi<5 TO)n . The schematic expression of the redefined basis is as follows: 
11 11 

$0 <=± $1 <=± $2 ' ' ' ^ $n-l ^ ^ $ n +l <=* ' ' ' • 



As shown in Sec. lIIIl this scheme is useful to deal with the classical stochastic processes, especially chemical reaction 
systems or particle creation-annihilation systems. 



B. Brief review of algebraic probability 

We here give a brief explanation of the algebraic probability. The algebraic probability is also called quantum 
probability or noncommutative probability. For details, see Ref. |9|. 

The algebraic probability is based on a *-algebra and a state defined on the *-algebra. In order to define a *-algebra, 
we firstly introduce an involution, which is defined as a map a i— > a* on an algebra A and satisfies 

{a + b)* =a* +b*, (Xa)* = Xa*, (ab)* = b*a*, (a*)* = a 

for a, b € A and A G C. A *-algebra is an algebra equipped with an involution. Next, we define a linear function 
(p on a *-algebra A with values in C, which satisfies the following two properties: (i) (positivity) ip(a*a) > 0; (ii) 
(normality) tp(l a) = 1, where I.4 is the identity. A linear function ip with the positivity and normality is called a 
state, and an algebraic probability space is a pair (A, tp) of a *-algebra A and a state tp on it. 
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C. Proposal of a definition of state for classical stochastic processes 



We here consider a stochastic process with discrete states indexed byn = 0,l,2,---. The probability distribution 
for the stochastic process is described as P(n), n = 0, 1, 2,- • • . For example, the state n corresponds to a number of 
certain chemical substances for chemical reaction systems. It is easy to extend the following scheme to multivariate 
cases, so that we explain only a single variable case for simplicity. 

One of the main claims in the present paper is a useful definition of state tp for the classical stochastic process. Firstly, 
we consider a certain Jacobi sequence, which is suitable to deal with the classical stochastic process. Some examples 
for the Jacobi sequences are shown in Sec. IIIII Secondly, in association with the Jacobi sequence, an orthogonal basis 
{<!>„}, the linear operators B ± , and the number operator N are introduced, explained in Sec. Ill Al Thirdly, we consider 
a *-algebra A constructed by B^ 1 and N. Note that we define (B ± )* = B T and N* = N. Finally, a state ip on A is 
defined as follows: 

,-t«< s I I > : [.,„ ] .„ I > /•(„•,*„ I ) = > ; («„,o*.), (7) 



(e^7*4 <, ( i:p( " ) *")) =e - 

\ m / \ n / / m.n 



U) m ■ ■ ■ OJi 

for a € A. Since P(n) is the probability distribution, the positivity and normality of the state tp are guaranteed. 

In order to explain the reason why we should use P{n) 1 not y P(n) like quantum mechanics, the following formal 
expressions are useful. Firstly, we focus on a time evolution of the classical stochastic process. The time evolution is 
governed by a master equation 

— P(n,t) = ^K nm P{m,t), (8) 

rn 

where P(n 1 t) is the probability with which the system is in state n at time t, and K = {K nm } a transition matrix. 
(It is also possible to treat a time-dependent transition matrix.) We set the initial condition as P(n, 0) = P(n). Here, 
a ket vector \n) is formally defined as 

|n) = $n, (9) 

and we introduce a state vector \ip(t)} as follows: 

\i>(t)) = J2 p (n,m n - (10) 

n 

Instead of the time evolution of P(n,£), we deal with the time evolution of the state vector \ip(t)) as follows: 

±\m) = L(B+,B-,N)\m), (ii) 

where L(B + , B~ , N) is a linear operator constructed by B and N. It is possible in general to construct the linear 
operator L(B + , B~ , N) in order to recover original master equations ((5]); in this case, each coefficient of the state 
vector \i/j(t)} at time t corresponds to P(n,t) for the original master equation adequately. The state vector \ip(t)} at 
time t is formally written as 

\il>(t))=exp(L(B+,B-,N)t)\1>), (12) 

where \ip) — J2 n P( n )^n- Next, we define a bra vector (m\ as a combination of $ m and the rest of the inner product; 
for example, when {<&„} are expressed by orthogonal polynomials, (m\ is defined as the integral part of the inner 
product and $ m ; please see Sec. IIIII in which examples of the definitions of the bra vectors (m\ are shown. Using the 
bra vectors {(m|}, a projection state vector is introduced as follows: 

(PI^E — " — H- (13) 

Hence, the state <p is redefined in terms of the projection state vector and the state vector: 

<p(a) = (V\a\i>), (14) 

for a G A. This expression using the bra and ket vectors might be familiar with physicists. Using the above redefinition, 
a statistical average of a physical quantity at time t, a(t), is obtained by ip(a(t)) = ip(a exp (L(B + , B~ , N)t)) . Note 
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that the time evolution operator is also in the *-algebra: exp (L(B + , B , N)t) E A. From the above constructions, it 
is clear that we should not use y/P(ri) in the definitions; if we use y/P(ri), the time evolution of a state vector could 
not be connected to the original master equation. 

We finally comment on the bra and ket vectors. These vectors and the operators {B^} are related to each other as 
follows: 

B+\n) = |n + l), n = 0,l,2,---, (15) 
B-|0) = 0, fl-|n)=w„|n-l), n = l,2,---, (16) 
(n|5 _ = <n+l|, n = 0,l,2,-", (17) 
(0|B+ = 0, (n\B+ = (n- l\w n , n=l,2,---. (18) 
These relations are immediately derived from the definitions. 



III. TWO EXAMPLES OF THE FORMULATION 

A. Canonical commutation relation 

The interacting Fock space associated with a Jacobi sequence {u>„ = n} is called the Boson Fock space 9 . In this 
case, we obtain the following canonical commutation relation (CCR): 

B-B+ - B+B- =1. (19) 

It has been shown that the CCR is useful in order to investigate chemical reaction systems, particle creation- 
annihilation systems, and ecological systems. We here note that the scheme based on the CCR corresponds to 
the Doi-Peliti formalism. 
In RefM 

it has been suggested that the Doi-Peliti formalism is related to orthogonal polynomials, i.e., the Hermitc 
polynomials and the Charlier polynomials. Using the scheme introduced in the present paper, this connection becomes 
more clearly, as follows. 

Let ^Pf m (M) be the set of probability measures on R having finite moments of all orders. Let {S„(x)} be the 
orthogonal polynomials associated with fi € *Pf m (R). From the theory of orthogonal polynomials, there exists a pair 



of sequences ax, ai, ■ • • G M and u>i,u>2, - ■ ■ > uniquely determined by 

3 (x) = 1, Hi (as) = x - a\, (20) 
xE n (x) = E n+1 (x) +a n+ xE n (x) +oj n E n _x(x), n = l,2, (21) 

For example, we have a n = and ui n = n for the Hermite polynomials; for the Charlier polynomials, a„ = A + n — 1 



and ui n = An, where A > 0. Although some modifications are needed for the Charlier polynomials in order to remove 
the effect of A. these two orthogonal polynomials have essentially the same form of {uj,-,} (the same n dependency). 
It is clear that the above {uj n } is a Jacobi sequence. This means that we have, in principle, various orthogonal 
polynomials in order to describe the CCR by choosing the sequence {a ra }. 

In order to discuss a general case, we here employ u n = An. In this case, we have a slightly different form of 
commutation relation, i.e., B~B + — B + B~ = A. This commutation relation is rewritten as (B~ / X)B + — B + (B~ /A) — 
1, and we recover the CCR by defining B~ /A as a new operator: BZ-. = B~ /A. According to this new definition, the 



actions of BX* = B + and on the bra and ket vectors are written as follows: 

B+ X) \n) = |n + l), n = 0, 1,2,---, (22) 

S ( - ) |0)=0, B ( - ) |n)=n|n-l), n = l,2,---, (23) 

(n\B w = (n + l\\-\ n = 0,l,2,---, (24) 

(0|£+ =0, (n\B+=(n-l\nX, n=l,2,---, (25) 



which have already been introduced in Ref. [T3 as a one-parameter extension of the Doi-Peliti formalism. 

The explicit constructions for the one-parameter extension has already been given in Ref. [T3- We here review a 
construction based on the Hermite polynomials. When we take a n = and uj n — An, the following rescaled Hermite 
polynomials {Hn X \x)} satisfies Eqs. (j2"0|) and (|2"Tj) : 
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where 

H n (x) = (-iy l e* 2 ^e-* 2 (27) 
is the usual Hermite polynomials. The rescaled Hermite polynomials satisfy the following orthogonality relation: 

H^(x)H^(x)^ x Hx)dx = \ n nl5 n , m , (28) 



where 



^Wfx^—Le-* 2 /^). (29) 
V^A 



Hence, we define the ket vectors, the bra vectors, and the linear operators as follows: 

/>oo 

|n) = HW(x), (n\ = / dx^(x)HW(x)(-), (30) 



= X & B i^Tx (31) 

Note that the integration in the bra vector (n| should be considered after taking the inner product with the ket vector 
|n); we indicate this fact using (•). We can confirm that the above definitions satisfy the properties in Eqs. (|22l) - (|25|) 
adequately. In addition, the projection state (P| can be expressed as 



ex P (5- } ) = f;-i-H (32) 



X n n\ 

71=0 

which is consistent with the previous worki^. 

Why is the CCR useful? One of the reasons is that transition rates in certain types of stochastic processes have a 
specific dependency on the state n. Here, we use a simple birth-coagulation process as an example. The birth reaction 
X —> X + X occurs with the rate constant a for each particle, and its backward reaction (coagulation) X + X —> X 
occurs with (3. The master equation for the process is written as 

—Pin, t) = a[(n - l)P(n - 1, t) - nP(n, ill + (3[n(n + l)P(n + l,t)-n(n- l)P(n, t)], (33) 
at 

where P(n,t) is a probability of finding n particles at time t, and we define P(— l,t) = 0. As one can see, the 
dependency of the transition rates on the number of particles /? seems to be easily dealt with the formalism in 
Eqs. (|2"2")l - (1231) . (For simplicity, we here use A = 1 and describe as i? ± .) Actually, the time evolution equation 
for a state vector defined as Eq. (fTUf is written as 

j t m))=L{B+,B-)m)), (34) 

where 

L(B+, B~) = a(B + - l)B+B- + /3(1 - B + )B + (B-) 2 . (35) 

This simple expression of the time evolution operator L{B + , B~) enables us to investigate the system in various 
analytical methods developed in quantum mechanics, e.g., a coherent-state path-integral formulation, perturbation 
calculations, renormalization group method, and so on. 

We finally comment on some relations with previous works for the Doi-Peliti formalism. For the Doi-Peliti formalism, 
the following expressions for the bra and ket vectors have been knownii: 



(m\ = J dx5(x)(±Y (■), 



(36) 



where 5(x) is the Dirac delta function. The corresponding linear operators B are as follows: 



B+ = x, B- = —. (37) 
da; 

These vectors and operators satisfy Eqs. (|2"2")) - (j2"5j) with A = 1. This construction is based on a generating function 
approach, and even in this case, the definition of the state (p in Eq. (1141) is useful and available. 
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B. Canonical anticommutation relation 



Here, we consider a simple hopping model, which has been used to study pumping phenomena in nonequilibrium 
physics^. The system consists of three parts, i.e., a left particle reservoir, a right particle reservoir, and a container. 
The left and right particle reservoirs are assumed to be large enough, and we only consider a change of state of the 
container. The container can have at most one particle, so that the state of the container is 'empty' or 'filled'. When 
the container is filled with one particle the particle can escape from the container by jumping into one of the two 
particle reservoirs. The transition rates, fci, fe-i, k 2 , k—2, are defined as the following scheme: 



Left reservoir 



fci k 2 
<=t [Container] ^ 

fc-1 fc-2 



Right reservoir 



We define p e {t) (p{(t)) as the probability with which the container is empty (filled) at time t. The master equation 
for the time evolution of p e (t) and pi(t) is 



d_ ( Pi (t) 
dt \pc(t) 



-k-i - hi k\ + fc-2 \ ( Pi(t) 

k-!+k 2 -ki-k-a) \p e (t) 



(38) 



In order to discuss the hopping model, the following Jacobi sequence is useful: u)% = 1 and uj n = for n = 2, 3, 
In this case, we have canonical anticommutation relation: 



B~B + + B+B 



1. 



(39) 



For clarity, the creation and annihilation operators for the canonical anticommutation relation are denoted as a + = B + 
and er~ = B~ , respectively. The following definitions are useful: 



eo 



ei 



(40) 











G 




-a 





(41) 



The actions of a ± to the vectors eg and e\ are as follows: 



eo 



ei 



0, 



ei 



eo 



0. 



Using the above vectors and operators, we have the corresponding time evolution equation for the state vector \ip(t)}, 
which is defined as 



as follows: 



where 



W*)) =Pe(t)eo +jJf(f)ei, 



-m))=L(a + ,a-)m)), 



(42) 



(43) 



Note that 



L(a + , a ) = (-fc_i - k 2 )<7 + <7 + (ki + fc- 2 )cr + + (fc_i + k 2 )<r + (-k t - k- 2 )a ^ 



o--a+ = 




1 



a+a- = 



1 




(44) 



(45) 



It is sometimes useful to analyze Eq. (1431) instead of Eq. (f3"5|); for example, Eqs. (|4"3")l and (|4"4")l is useful in order to 
discuss the counting statistics in the following section. 

We finally note an extension for multiple state cases. The hopping model can be formulated based on M(2,C), 
because there are only two possible states (empty or filled). It is an easy task to extend it to n-state cases, which 
are formulated in terms of M[n, C). Hence, in principle, it is possible to describe a stochastic process with a finite 
number of states in terms of the algebraic probability. 



7 



IV. APPLICATION TO COUNTING STATISTICS 

A. Aims of counting statistics 

As an applications of the formalism of the algebraic probability, we here derive a scheme in the counting 
statistics^—. In the counting statistics, we count the number of specific transitions. For example, we here 
count the number of hopping between the container and the right reservoir in the hopping model in Sec. IIII Bl Using 
the counting statistics, all statistics, including the higher-order moment, can be evaluated. A stochastic process is 
described by a transition matrix, and it has been shown that a slightly modified transition matrix plays an important 
role in the counting statistics. While a derivation based on a generating function has already been given, we will show 
that the scheme in the counting statistics can be treated within the algebraic probability; the modified transition 
matrix is obtained from an intuitive discussion. 



B. Basic equations in counting statistics 

We firstly explain basic equations used in the counting statistics. In order to explain them, we use the hopping 
model introduced in Sec. IIII Bl (The hopping model is a nice toy model in order to investigate nonequilibrium behavior, 
and actually the counting statistics for the hopping model has been already studied^—.) 

A net flow between two transitions is often investigated in nonequilibrium physics. For example, in the hopping 
model, the net flow from the container to the right reservoir is calculated as a subtraction of "(i) the number of 
hopping from the right reservoir to the container" from "(ii) the number of hopping from the container to the right 
reservoir" . 

In order to investigate the statistics of the net flow, it is a common way to construct a generating function. Let 
P(Na\£) be the probability with which there are N\ net transitions from the container to the right reservoir during 
time t. Since is defined as the subtraction of (i) from (ii), JVa is an integer value and it can be negative. The 
generating function Z(<fi,t) for the statistics is defined as follows: 

oo 

Z(<f>,t)= J2 P{NA\t)e iNA4, . (46) 

N A = -oo 

Using the generating function Z(<j>,t), all statistics related to the net flow can be evaluated. However, at this stage, 
the probability P(NA\t) is not known. In stead of an explicit calculation of P(-/Va|£), it has been shown that the 
following basic equation is useful^: 

d. (f { (<p, t)\ _ ( -fc-i - Aa fci + k-2e-^\ (M<f>, t)\ , 
dt\M,*)J [k-i+haft* -h-k- 2 J\f e (<f>,t)J- 

Using the solution of Eq. (|4"T|) , the generating function is evaluated as 

zf>,t) = M4>,t) + f e (4>,t). (48) 

Note that the matrix in Eq. f|4T[) is very similar to the transition matrix of the original master equation (Eq. (|38[1 ). 
but this matrix does not satisfy the probability conservation. We here call it the modified transition matrix. 

The derivation of the basic equation (Eq. (|47p) has been performed in terms of the generating function approach. 
(For example, see Ref. |13D However, the derivation is a little complicated, especially when one wants to count 
multi-target transitions, like the example here; we here count not only (i), but also (ii) simultaneously. 

In the following subsections, we explain how the basic equation is easily derived from the discussions of the algebraic 
probability. 



C. Combination of two interacting Fock space 

In the scheme of the algebraic probability discussed in Sec. HH the index n cannot be negative. However, as 
explained before, the net flow can be negative, and hence the negative variables should be considered. In order to 
treat the negative n for the counting statistics, we here combine two interacting Fock space; one describes a positive 
contribution and another corresponds to a negative contribution. 
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While there may be various constructions for the two interacting Fock space, we here employ two spaces with 
the CCR (with A = 1). Hence, a joint probability distribution is used, i.e., P(n pi n n ) for n p = 0,1,2,- •• and 
n n = 0, 1, 2, • • • . The variable n p corresponds to the number of transitions corresponding to the positive contribution, 
and n n to the negative contribution. Using the following ket vector 

\n p ,n n ) = \n p ) <g> |n n ), (49) 

we define the linear operators B p as follows: 

B+ = B + ®1, B-=B-®1, B+ = 1®B+, B- = 1®B-. (50) 

For example, the creation and annihilation operators for the positive contribution part, B p , act on the ket vector 
\n p ,n n ) as follows: 

\n p ,n n ) = \n p + l,n n ), B p \n p ,n n ) — n p \n p — l,n n ), (51) 

N p \n p ,n n ) = B+B p \n p ,n n ) =n p \n p ,n n ), (52) 

for all n p . The inner product between the bra and ket vectors becomes 

(m p ,m n \n p ,n n ) = n p !n n !(5 TOpi „ p (5 TOn> „ n . (53) 

For the negative contribution case, two linear operators B„ are defined in a similar manner. Next, we consider 
analytic representations for the bra and ket vectors, and the linear operators B p n . In order to connect the discussions 
below with the generating function approach, we use the following definition of the Kronecker delta: 



1 

27 



2ir 

d e i(«-™)0. (54) 



Hence, the following analytical representations are obtained: 

2ir~ 



n p )=e in ^, ( mp | = !^:/ d^e-^H), (55) 



B p^ P < ^" = -^4' N ^ = B ^ = - i W P (56) 

For the negative contribution case, similar representations are obtained. From the construction, we have N p \n p , n D ) > 
and N n \n p ,n n ) > 0; these schemes do not violate properties of the algebraic probability. 

In order to count the net flow, we must consider the operator N p — N n , which means that -/V p gives the positive 
contribution and iV n describes the negative contribution. Hence, the following number operator should be introduced: 

N C = B+B--B+B~. (57) 

Next, we employ variable transformations: <f) p — <p, and <p n — 4>' — <j>. Due to the variable transformations, the ket 
vector |n p ,n n ) becomes 

\n p , n n ) = e^e^" = e'^-^M^ ( 58 ) 

and we have 

N e = -i±. (59) 

Actually, the number operator 7V C acts on |n p ,n n ) as 

N c \n p ,n n ) = (n p -n n )\n p ,n n ). (60) 

Notice that the operators B~ or B~ does not used alone in the counting statistics: n p and n n cannot decrease with 
time, and there is no need to consider the single action of B~ and B~ in the formalism. If we want to decrease the 
number of transitions, we should increase n n instead of the decrease of n p . This indicates that we can set 4>' = for 
simplicity, and the following two operators are introduced: 

B+=j+, B-=e-'^. (61) 
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In addition, introducing n c € Z and n c = n p — n n , the following ket vector, which stems from |n p ,n n ), should be 
useful in the counting statistics: 

K) = e in ^. (62) 

In summary, we have the following relations: 

B+\n c ) = |n c + l), B-\n c ) = \n c -l), (63) 
^ c |n c ) =n c |n c ). (64) 

The above constructions means that the ket vectors suitable for the counting statistics can be generated adequately 
from the two interacting Fock spaces. Notice that this scheme does not violate the properties of the algebraic 
probability. While n c can take a negative value, the positivity of the state (ip(a*a) > 0) is still satisfied when we 
consider a *-algebra is constructed by and N c . (Note that (N c )* — N c .) 



D. Derivation of the basic equations in the counting statistics 

We here discuss how the constructed Fock space in Sec. lIV Cl is used in the counting statistics. Again, as an example, 
a counting problem for the hopping model in Sec. IIIIBl is considered. 

We calculate a net flow from the container to the right reservoir. If a particle hops from the container to the right 
reservoir, we count it as +1; —1 for a particle hopping from the right reservoir to the container. This means that the 
counting process is also a stochastic process; not only the stochastic process for the hopping model, but also that for 
counting statistics should be considered simultaneously. Hence, we define a joint probability P(s, n c , t) with which the 
system is in s (s £ {e,f}) and the net flow with n c £ 7L at time t. The state vector \4>(t)) in the algebraic probability 
is defined as 

oo 

M*)>= E E P(s,n c ,t)\s,n c ). (65) 

s£{e,f } n c = -oo 

For the hopping model, a quantity at time t is evaluated by using the operator exp(L(<r + , a~)t), where L(a + ,a~) is 
defined as Eq. (|44|) . How should we construct the operator L c (a + ,<r~ , B+ , B~) for the counting statistics case? In 
order to obtain it, we consider small time interval At and the operator exp(L(tr + , a~)At) for the hopping model. We 
have 

exp (L(a + , <j~)At) ~1 + L(a + , a~)At 

= [l + (-fc-i - k 2 )At(j + (j- + (-fci - fc_ 2 )Ato-~o-+] 

+ ki Ata + + k- 2 Ato + + k-i Ata~ + k 2 Ata~ . (66) 

Each term in Eq. (|66|) can be interpreted as follows. The second term means that there is a state change caused by er + 
and its probability is k\At. With this probability, a particle is hopping from the left reservoir to the container. The 
third term corresponds to a particle hopping from the right reservoir to the container, and so on. The first term shows 
a case in which no transition occurs. In our problem settings, the net flow from the container to the right reservoir 
should be calculated, and hence we immediately notice that the following linear operator L c (a + , er~, B~) for the 
time evolution of 1^) should be used: 

L c (a + ,a-,B+,B-) 

= - k 2 )<7 + <j- + (fci + k_ 2 B-)(j + + (fc_! + k 2 B+)a- + (-fci - k- 2 )cj-cT + . (67) 

That is, the transition from the container to the right reservoir (the term k 2 a~) is followed by B+ . In addition, B~ 
is combined with the transition from the right reservoir to the container (the term k- 2 a + ). In a matrix formulation, 
we obtain 

where we used Eq. (|6i"l) . This is actually the modified transition matrix in Eq. (|47|) , and as a result, the above 
discussions give the basic equation for counting statistics immediately. As exemplified here, the operator or the 
modified transition matrix for the counting statistics is easily and intuitively obtained using the scheme of the algebraic 
probability. 
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E. Counting statistics for continuous values 

We sometimes need to consider cases with non-integer counting. For example, when one wants to calculate entropy 
productions in a stochastic process, each transition causes entropy production, and the entropy production is not an 
integer but a continuous value. We will show that the construction based on the algebraic probability is also available 
for the non-integer cases. 

We assume that a certain transition occurs and an quantity r\ is produced due to the transition. Note that 77 is a 
continuous value and it can be negative in general. In order to apply the counting statistics explained in Sec. IIVD1 
let introduce a small interval A and approximate rj as follows: 

r] = n n A + e, e > 0, (69) 

where n n = L^/AJ and we used the floor function 

[r]\ = max{n € Z\n < rf\. (70) 

Since n v A is an integer, we can use the scheme of the counting statistics explained above. In the counting statistics, 
there is only one increment +1 (or one decrement —1) due to a target transition, so that we employ (or B~). In 
the non-integer case, one transition occurs the change with rj, and hence we should use (B+) n i A . (If n n < 0, this 
operator corresponds to (B~y n ' , \ A due to Eq. (|61|) . so that there is no need to consider B~ explicitly here.) Taking 
the limit A — > 0, we obtain (£?+) nr,A ~ e"'^, which is consistent with the previous work for the entropy production-^. 

V. CONCLUDING REMARKS 

In the present paper, we gave a definition of a state in algebraic probability, which is suitable for classical stochastic 
processes. Based on a Jacobi sequence, an interacting Fock space is constructed. Using this construction, the Doi- 
Peliti formalism can be connected to the orthogonal polynomials naturally. In addition, the scheme is applied to the 
counting statistics, which enables us to understand the meanings of the modified transition matrix in the generating 
function approach; the multiplied factors in the modified transition matrix correspond to creation and annihilation 
operators for the counting process. As a result, it is clarified that we can deal with various methods studied previously 
in a unified way. 

One may consider that commutative operators correspond to classical systems, and noncommutative ones mean 
quantum systems. However, as clarified in the present paper, the noncommutative relation does not mean directly 
quantum systems; certain types of classical stochastic processes are adequately dealt with the noncommutative opera- 
tors. Only a difference between a quantum case and a classical stochastic process is within the usage of the probability 
P(n), not the square root, for the definition of the state. 

ACKNOWLEDGMENTS 

This work was supported in part by grant-in-aid for scientific research (No. 20115009) from the Ministry of 
Education, Culture, Sports, Science and Technology (MEXT), Japan. 

1 M. Doi, J. Phys. A: Math. Gen. 9, 1465 (1976). 
2 M. Doi, J. Phys. A: Math. Gen. 9, 1479 (1976). 
3 L. Peliti, J. Physique 46, 1469 (1985). 

4 U.C. Tauber, M. Howard, and B.P. Vollmayr-Lee, J. Phys. A: Math. Gen. 38, R79 (2005). 

5 N.A. Sinitsyn and I. Nemenman, Europhys. Lett. 77, 58001 (2007). 

6 J. Ohkubo, J. Stat. Mech., P09017 (2007). 

7 J. Ohkubo, J. Chem. Phys. 129, 044108 (2008). 

8 N.A. Sinitsyn, J. Phys. A: Math. Theor. 42, 193001 (2009). 

9 A. Hora and N. Obata, Quantum probability and spectral analysis of graphs (Springer, Berlin Heidelberg, 2007). 
10 J. Ohkubo, Phys. Rev. E. 86, 042102 (2012). 

n M. Droz and A. McKane, J. Phys. A: Math. Gen. 27, L467 (1994). 
12 I.V. Gopich and A. Szabo, J. Chem. Phys. 118, 454 (2003). 
13 I.V. Gopich and A. Szabo, J. Chem. Phys. 122, 014707 (2005). 
14 I.V. Gopich and A. Szabo, J. Chem. Phys. 124, 154712 (2006). 
15 T. Sagawa and H. Hayakawa, Phys. Rev. E 84, 051110 (2011). 



